Chinese named entity recognition model based on BERT
نویسندگان
چکیده
Nowadays, most deep learning models ignore Chinese habits and global information when processing tasks. To solve this problem, we constructed the BERT-BiLSTM-Attention-CRF model. In model, embeded BERT pre-training language model that adopts Whole Word Mask strategy, added a document-level attention. Experimental results show our method achieves good in MSRA corpus, F1 reaches 95.00%.
منابع مشابه
Chinese Named Entity Recognition Based on Hierarchical Hybrid Model
Chinese named entity recognition is a challenging, difficult, yet important task in natural language processing. This paper presents a novel approach based on a hierarchical hybrid model to recognize Chinese named entities. Three mutually dependent stages-boosting, Markov Logic Networks (MLNs) based recognition, and abbreviation detection are integrated in the model. AdaBoost algorithm is utili...
متن کاملChinese Named Entity Recognition Using Role Model
This paper presents a stochastic model to tackle the problem of Chinese named entity recognition. In this research, we unify component tokens of named entity and their contexts into a generalized role set, which is like part-of-speech (POS). The probabilities of role emission and transition are acquired after machine learning on a role-labeled data set, which is transformed from a hand-correcte...
متن کاملTransliterated Named Entity Recognition Based on Chinese Word Sketch
One of the unique challenges to Chinese Language Processing is cross-strait named entity recognition. Due to the adoption of different transliteration strategies, foreign name transliterations can vary greatly between PRC and Taiwan. This situation poses a serious problem for NLP tasks: including data mining, translation and information retrieval. In this paper, we introduce a novel approach to...
متن کاملChinese Named Entity Recognition and Disambiguation Based on Wikipedia
This paper presents a method for named entity recognition and disambiguation based on Wikipedia. First, we establish Wikipedia database using open source tools named JWPL. Second, we extract the definition term from the first sentence of Wikipedia page and use it as external knowledge in named entity recognition. Finally, we achieve named entity disambiguation using Wikipedia disambiguation pag...
متن کاملRole-based model for Named Entity Recognition
Named Entity Recognition (NER) poses new challenges in real-world documents in which there are entities with different roles according to their purpose or meaning. Retrieving all the possible entities in scenarios in which only a subset of them based on their role is needed, produces noise on the overall precision. This work proposes a NER model that relies on role classification models that su...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: MATEC web of conferences
سال: 2021
ISSN: ['2261-236X', '2274-7214']
DOI: https://doi.org/10.1051/matecconf/202133606021